Quantum thermodynamics: thermodynamics at the nanoscale 
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A short introduction on quantum thermodynamics is given and three new topics are discussed: 1) 
Maximal work extraction from a finite quantum system. The thermodynamic prediction fails and a 
new, general result is derived, the "ergotropy". 2) In work extraction from two-temperature setups, 
the presence of correlations can push the effective efficiency beyond the Carnot bound. 3) In the 
presence of level crossing, non-slow changes may be more optimal than slow ones. 



Thermodynamics originated in the nineteenth century 
as a science of engines. It took a while before it was un- 
derstood that its laws originate from a molecular picture 
and, with it, the theory at that scale, quantum mechan- 
ics. Still, these efforts dealt with macroscopic systems. 

When going to the limits of thermodynamics, one may 
wonder whether it exists for finite systems in the quan- 
tum regime, like few level atoms. At first sight, this 
seems a hopeless task. After all, there is nothing ther- 
modynamical in the groundstate of the hydrogen atom, 
so why should there be such behavior for other finite sys- 
tems? But let us notice that a thermodynamic setup 
deals with three parts: the system under consideration, 
a bath and a work source. The latter both have to re- 
main extensive for having the proper physical meaning: 
the work source transfers high-graded energy (energy- 
without-entropy), while the bath transfers low-graded 
energy related to uncontrollable, thermalized degrees of 
freedom. In this setup there is a hope to understand ther- 
modynamical laws directly from quantum mechanics. 

One of the first question is then: can the energy U of 
the system S be uniquely identified, even though there is 
a non-small coupling to the bath? We have shown before 
that this can be done in two well known system-f bath 
models: the Caldeira-Leggett model of a damped quan- 
tum particle in an external potential and the spin-boson 
model of a spin in the presence of a bath. For the 
Caldeira-Leggett model the Hamiltonian reads 
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Htot = H + Hb+Hi, H=^ + V{x) 
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and we choose a dense quasi-Ohmic spectrum 



} Z ^ m:l,): 



(2) 



where 7 is the coupling or damping constant and T the 
'Debye' cutoff frequency. Studying the Langevin dynam- 
ics, it was seen that for times larger than the inverse 
Debye frequency l/F, the unitary part of the equations 
of motion is given by the Hamiltoniap^ 
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+ V{x) - -iTx\ 
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For the harmonic case V — ^bx^ this implies an effective 
spring constant a = b — "fT and b > 7F or a > 0. This is 
exactly what is needed for stability of the overall system. 

Now the internal energy is uniquely defined as U = 
ivpHs, where p is the density matrix. A similar approach 
works'' in the spin-boson model ^ , the most important dif- 
ference being that the (bare) Hamiltonian of the system 
already does the job. 

The action of a macroscopic work source on the system 
S will be to make a parameter (for instance the effective 
mass m or the spring constant b) time-dependent. There- 
fore also the workdM^ done on S can be uniquely defined, 
asAW = ivpdH = tvp [{dH /dm)dm+{dH/db)db]. It co- 
incides with minus the energy change of the work-source. 

Having these two ingredients, the first law is estab- 
lished, with the heat added to S: dQ = dU—dW. This in- 
dicates that Quantum Thermodynamics exists as a non- 
trivial subject. 

Now we can go to the second law. In the absence of 
a thermodynamic limit, its many formulations have dif- 
ferent domains of validity. So one can no longer speak of 
the second law and, moreover, entropy is a bad indicator 
for a variety of reasons, see below. 

In the PQE-2003 proceedings it was pointed out thali^: 

a) . A generalized Thomson formulation (cycles cost 
work) is generally valid, provided the total system (in- 
cluding the bath and coupling to it) starts in gibbsian 
equilibrium^. An example of this case is to make a cyclic 
change in b. ^ 

b) . The Clausius inequality dQ < TdS can be vio- 
lated. This violation sets in at high T in subdominant 
fi^/T terms, and becomes strongest at T = 0, where TdS* 
vanishes. The physical mechanism is the formation of a 
cloud of bath modes around the central system, as occurs 
for polarons and Kondo systems. Energy of this cloud can 
enter dU as heat. Experimental tests have been designed 
for quantum electronics ^ and quantum optics^. 

c) . The rate of irreversible (non-adiabatic) work - 
sometimes called energy dispersion, when referring to 
the energy of the work source - may be negative at low 
enough T. This contrasts the classical case where it is 
equal to T times the rate of entropy production. As a 
result, starting out of equilibrium, a finite number of cy- 
cles could be designed where work is extracted from the 
bath^. 
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1). The first new problem we treat here is one of the 
most known ones in thermodynamics: what is the max- 
imal amount work that can be extracted from a non- 
equilibrium finite quantum system via cyclic processes^? 

The maximal work- extraction problem is posed in the 
following waji2i£. Let a system S be in an initial state 
with density matrix po and have Hamiltonian H. Cer- 
tain external fields are exerted on S in the time-interval 
[0, r], which amount to a cyclic variation of the Hamil- 
tonian: H{0) = H{t) = H. As S is assumed to be ther- 
mally isolated (it moves under external fields and its own 
dynamics), the work W done by external sources isiS 

W ^tr[Hpr]-tv[Hpoi (4) 

where pr is the state of S at the final moment r. Work 
is extracted if < 0, and the questions is what is the 
maximal amount \W\ which can be extracted, given pa 
and Hmj^. The standard answerJ-^ starts with postulating 
that the final state is in equilibrium at some temperature 
Tf = l//3f, 

Pr=Pi = ^-, Z = tre-ft^. (5) 

The work is then Wth = Uf{Sf) - Ui, where Uf ^ tr [pfH] 
is the final (average) energy as a function of final entropy 
S{ = — trpflnpf, and Ui is the initial energy. Since in 
the final equilibrium state dUf/dSf = Tf > 0, for Wth 
to be minimal, one should keep Sf as small as possi- 
ble. As the entropy of a thermally isolated system can 
only increase^iS., the maximal amount of extracted work is 
achieved for conserved entropy: S{ — S{0) = — tr po Inpg. 
This condition serves to determine Tf. Some known re- 
sults follow: i) When comparing two different initial 
states Po and ctq of S having the same initial energy, 
more work can be extracted from that one which has 
lower entropy, ii) Conversely: if the maximal work ex- 
tracted from Po is larger than that from ctq, po had a 
lower entropy. Hi) If there is an independent, uncorre- 
lated system il ( "spectator" ) with initial state luq and 
Hamiltonian Hi^, then it just follows from the additivity 
of the entropy: S{po (S) uJo) — S{pq) + S{ujq), that more 
work can be extracted from po (g) ujq than from (Tq (io- 
Maximal work extraction in quantum mechanics. It is 
now our purpose to solve the maximal work extraction 
problem directly from quantum mechanics, without in- 
volving any postulate. Let us start from the spectral 
resolutions 

Po = ^Pj\Pj){Pj\, H = ^ek\ek){ek\, (6) 

j>l k>l 

where Sk, Pk, \£k), \pk} are the eigenvalues and orthonor- 
mal eigenvectors of po and H, respectively. We order the 
eigenvalues as 

Pi > P2 > ■ ■ ■ , £i <£2< ■■■ (7) 



Since S is assumed to be thermally isolated, its evolu- 
tion is unitary: pr = U{t) pQ W(t), with ihdU{t)/dt = 
H{t)U{t). ^ 

The maximal extracted work W = — Wmax was deter- 
mined in ^: 

W=Ua-^Pk£k, Uq= ^\{pk\£^)\^£^Pk■ (8) 
fe>l i,fc>l 

For W, which depends only on the initial state and 
Hamiltonian, we coin the name ergotropy, from the an- 
cient Greek, epjoTponeLa — work-transformation, trans- 
formation into work, {ep^ov, work; Tponr], transfor- 
mation, turn); in analogy to Clausius' entropy, {ev — 
TpoTTSia, in-transformation) . 

It can be shown'' that Wth > W > 0, and it is 
typically not equal to the thermodynamical expression 
Wth = Ui — Uf{Sf), because a unitary dynamics conserves 
all eigenvalues of po and not only its entropy. These 
additional conserved quantities are important for finite 
systems, the thermodynamically optimal state is typically 
unreachable quantum mechanically. For macroscopic sys- 
tems the effect disappears or at least is expected to be 
very small - in the same way as energy is the only relevant 
constant of motion for a closed macroscopic system^i^. It 
thus holds that W < Wtn^. 

The behavior of W can be rather different from that 
of its (unreachable) upper bound Wth: i) states with a 
larger von Neumann entropy may produce more work; ii) 
introduction of a spectator system can invert the work- 
producing ability, that is, W((7) > W(/5) can be consis- 
tent with W(a)®(T) < W(tD(g)/5). These and other related 
effects are discussed in detail in ^ . The standard thermo- 
dynamic behavior is still valid for finite systems, but only 
within the set of states that majorize one- another ^. In 
that case the standard von Neumann is the proper indi- 
cator of work-providing ability. 

2). Work- extraction from a correlated two-temperature 
system may exceed the Carnot bound. The most tradi- 
tional object of work-extraction is a pair of equilibrium 
systems Si and S2 with Hamiltonians Hi and H2, respec- 
tively. The total Hamiltonian \s H = Hi -\- H2 as Si and 
S2 do not interact initially. Initially, at i = 0, Si and S2 
are in equilibrium states 

/5,(0) = ^^, Z,=tre-^^^^ j = l,2. (9) 

at temperatures T2 > Ti. The total state of the baths 
Po may be correlated: though pi^2 = tr2,i/0o, it may hold 
that Po Pi ® P2- The maximal work \W\ is extracted 
from till r, while for i > r one switches on for the 
system 1 (2) a weak interaction with a thermal bath at 
temperature Ti (T2). Due to this, both systems sepa- 
rately relax back to their original states pi(0) and P2{^) 
given by lO, though the total state need not return to 
Po- Changes of energies during this relaxation are com- 
pletely attributed to heat. The heat Qi {Q2) given by 



3 



the first (second) bath is: 

Q, = tr[4 p,m - tr[4 p,(t)], j = 1, 2. (10) 

This is equal to the final energy of the bath minus the its 
initial value: the extracted work comes fi'om the baths. 

We now present a new, general theorem for this setup. 
For any system S with Hamiltonian H in a. state p with 
energy U = \,v[pH], one defines the thermodynamic en- 
tropy ^th = PU — In Z as the von Neumann entropy of an 
equilibrium state Poq — exp[— with the same en- 
ergy. The temperature T ^ 1/(3 follows from dS'th/dJ7 = 
f3. Since d^SthiU)/dU^ = -1/{{H-U)^) < 0, St^iU) 
is a monotonic and concave function. Now the identity 
5,(0) - Sjir) = SthiU^m ~ 5th(f/,(r)) for j = 1, 2 im- 
plies, using Eq. (^Ul and that f{x) - f {y) > f'{x){x - y) 
for any concave function /, 

5th(;7,(0)) - 5th(C/,(r)) > ( UM - U,{t) ) = P,Q,. 

(11) 

Here the Sj — — tr pj In pj are partial entropies, while 
S = — tr pq In pq is the total entropy. Together they define 
the non-negative correlation entropj*^ 

^corr = 5i + 52 - 5 > 0. (12) 

Considering this relation at i = and t ~ t, using 
S{t) = 5(0) (unitarity), ehminating Qi — \W\ — Q2 (en- 
ergy conservation), and noting Q2 > ^ due to T2 > Ti, 
one gets from (|ll|l as efficiency of the cycle 

\W\ Ti Ti 

If the initial state was factorized: po — pi{Q) P2{0), the 
maximal work extraction procedure will leave the final 
state in a factorized form, so 5corr,i = 5corr,f = 0, imply- 
ing the maximal possible efficiency is the Carnot bound. 
For a factorized po, the total state of Si and S2 will re- 
turn to it after interactions with the bath, so the whole 
procedure can be repeated. This is another formulation 
of the second law, but notice that our work extraction 
timescale, much smaller than the relaxation time of the 
bath, is not the most general one. 

When the initial state is not factorized, the efficiency 
(|13|l is not bound by Carnot: correlations can be traded 
for efficiency. Such a result was found before in a setup 
of a laser cavity heated by a correlated three-level atom 
beam by Scully et al>i£ and discussed at PQE 2003. 

3). Non-adiabatic variations may exceed the thermo- 
dynamic work performance. One of the formulations of 
the second law, the minimal work principle, states that 
work done on a thermally isolated equilibrium system 
is minimal for adiabatically slow (reversible) processes. 
Within the domain of finite quantum systems, it appears 
to be indeed generally valid provided the adiabatic en- 
ergy levels do not cross. If level crossing does occur, this 
principle can be violated and optimal processes are nei- 
ther adiabatically slow nor reversible. — 



Formulation of the principle. Consider a quantum sys- 
tem S which is thermally isolatedZiSiii: it moves accord- 
ing to its own dynamics and interacts with an external 
work source W. This interaction is realized via time- 
dependence of some parameters R{t) — [i?i(i), ...,Rn{t)] 
of the system's Hamiltonian H{t) — H[R{t)]. They move 
along a certain trajectory R{t) which at some initial time 
ti starts from i?i = R{ti), and ends at R{. The initial 
and final values of the Hamiltonian are Hi = H[Ri] and 
Hi ~ H[Rf], respectively. Initially S is assumed to be 
in equilibrium at temperature T = 1//3, that is, S is de- 
scribed by a density operator: 

/5(ti) = exp[-/3i7i]/Zi, Zi^tTe-f""'. (14) 

One considers various processes which start from the 
same equilibrium state (|14|l with R moving between Ri 
and Ri along a trajectory R(t). The statement of the 
minimum work-principle then readsiSiii 

> Wad : (15) 

The actual work W done on S when moving along the 
trajectory R{t) is not smaller than the work Wad done 
during the adiabatically slow variation between the same 
initial and final values Ri and i?t and along the same tra- 
jectory R{t). By adiabatically slow we mean a process 
which is realized with homogeneously vanishing velocity 
and which thus takes very long time t{ — ii, much longer 
than the proper characteristic time of S. For thermally 
isolated systems S adiabatically slow processes are re- 
versible. This is standard if S is macroscopic^'^' and 
was shown to be true also in the finite domain, where the 
definition of reversibility extends unambiguouslyi^ (i-e., 
without using entropy). 

Eq. (|15|l is a statement on optimality: if the purpose 
of the external source W is to extract work from S, then 
the actual work W is negative, and to make it as neg- 
ative as possible one proceeds with very slow velocity. 
On the other hand, if during some operation the work 
has to be put into S, that is W has to be positive, one 
tends to minimize its amount, and again operates adia- 
batically slow. In macroscopic thermodynamics the min- 
imum work principle is derived^'^ from certain axioms 
which ensure that, within the domain of their applicabil- 
ity, this principle is equivalent to other formulations of 
the second law. Derivations in the context of statistical 
thermodynamics are presented iniSii^. 

The minimal work principle for macroscopic systems 
is proven in two steps: first one establishes an inequal- 
ity between the work and the free energy difference, 
while in the second step one uses macroscopic features 
of S to connect it with the adiabatic work. One starts 
with the relative entropy ti[p{t[) In p{t[)—p{t{) In pcq{H[)] 
between the final state p(t{) and an equilibrium state 

Pcq{Ht) = exp[-j3H{]/Zi, Z{ = tre^*^-^' . It has the same 
temperature T = 1//3 as the initial state p{ti), but cor- 
responds to the final Hamiltonian H{. As follows from 



4 



unitarity, tr[p{tf) \n p{t{)] = tr[p{ti)ln p{ti)]. Combined 
with 1)141 nil and non- negativity of relative entropy^, this 
yields: 

W > F{Hf) - F{Hi) EE Tlntr[e"'^^'] - rintr[e"'^^f]), 

where F{Hi) and F{Hi) are the free energies correspond- 
ing to p(ti) and pcq{H[), respectively. There are several 
classes of macroscopic systems for which one can show 
that the free energy difference F{H{) — F{Hi) indeed co- 
incides with the adiabatic work^iiSii^. 

Finite systems^ For an arbitrary A'^-level quantum 
system S, Eq. (|16(l does not have the physical meaning 
we need, since in general F{H[) — F{Hi) has no reason 
to coincide with the the adiabatic work needed in (|15|l . 
Therefore, one needs an independent, possibly general, 
proof of (|15|l . In — we present one, starting from the 
quantum evolution equations and using ideas from—. 

Let the spectral resolutions of H{t) and p{ti) be 

N 

H{t)=J2^k{t)\k,t){k,t\, {k,t\n,t) ^ Skn, (16) 
fc=i 

/c=l ^ 

The ordering iQ is satisfied a,t t = tj. For U < t < 
tf we expand on the complete set \n,t): U{t)\k,ti) = 

E^=iafc"We"*^'''**'''"^*'^ \n,t), and uses to get: 

N-l 

W-W^i= ^ [£,„+! (tf )-e™ (if )]e„, (18) 

m — 1 

m N 

e™ = Y.Y.P'^^ lafen(tf)l' - |afc„(tf)n.(19) 

n=l fc=l 

Assume now that the ordering ([TJl is kept at t = ti: 

ei(if) < ... <£jv(if). (20) 

If energy levels did not cross each other, i.e. ek+i{t) — 
£k{t) did not change its sign as a function of t for 
ti < t < ti, then H2U|) is implied by O. According to 
non-crossing rule^^, if only one independent parameter 
of the Hamiltonian H{t) is varied, the above condition 
is satisfied for any discrete-level quantum system: level- 
crossing, even if it happens in model-dependent calcu- 
lations or due to approximate symmetry, does not sur- 
vive arbitrary small perturbation and is substituted by 
avoided crossing. In that case the standard adiabatic 
theorem of quantum mechanica^^ leads to 

afcri(tf) = Skn (21) 



It follows from |afc„(tf)p = \{n,ti\U\k,ti}\'^ that 

N N 

J2 |afen(tf)P = I«fc"(*f)l' = 1- (22) 

k=l n=l 

Combined with (0 EU this brings 6^ > 0. Together 
with Eqs. ((71 120(1 this proves the minimum work principle 
((15(1 for finite systems, without requiring a connection 
with the free energy differencsi^. 

Level crossing. What happens if the adiabatic energy 
levels cross, i.e. ((20(1 is not valid? As an example we 
consider a spin- 1/2 particle with Hamiltonian — 

H{t)^hi{s)ai~h3{s)a3, s^t/T, (23) 

where ai and are the corresponding Pauli matrices, 
and s is the reduced time with t being the characteristic 
time-scale. The external magnetic fields hi and /13 vary 
smoothly in time. Assume that i) for s si < and 
for s — > Sf > 0, /ii(s) and /i3(s) go to constant values 
sufficiently fast; ii) for s — > one has: hi{s) ~ ais^, 
/i3(s) ~ —a^s, where ai and > are constants. Hi) 
hi{s) and /i3(s) are non-zero for all s, Sj < s < Sf , except 
s — 0. For large r one getsii 

which for t — > 00 is in accordance with the adiabatic 
theorem (jHl- From HHI) we have W - VFad = [£2 (if) - 
ei(tf)]6i. Using 61 = (pi - P2)|ai2(tf)P > we find, 
because of the level crossing, W — W^d — —\£2{tf) — 
£i(tf) \ ©1 < 0, thus confirming the violation of the min- 
imum work principle. Eq. 1(241) also shows that the role 
of the proper internal characteristic time is haf/a^. 

In the above two-level example one crossing was suf- 
ficient to violate ((15(1 with practically any non-adiabatic 
variation which produces Qi > 0. For a many-level S 
having two of its levels crossed, any non-adiabatic varia- 
tion will not do anymore, as only one term in the RHS of 
((18(1 will be negative. However, for quasi-adiabatic vari- 
ations - and provided H{t) is analytic - the transition 
probabilities between non-crossing levels are exponen- 
tially smal liiTiiT i, while as we seen it has power-law small- 
ness for the two crossing levels. For this situation one 
can neglect in 1(18(1 the contribution from non-crossing 
levels, and the problem is reduced to the two-level sit- 
uation. The same concerns macroscopic systems which 
have at least two discrete levels at the bottom of a con- 
tinuous spectrum, whenever for low temperatures these 
levels decouple from the rest of the spectrum. 
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